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Abstract: A wide variety of systems requires reliable security 
schemes ensured by different conventional methods. In most 
cases these methods are either too much costly or very slow 
for real world applications. This paper will discuss a new ap- 
proach to provide the desired level of security by using an 
autonomous weapon which can detect and immobilize the 
safety hazard to the system using powerful image processing 
methods. The paper also summarizes its advantages , disad- 
vantages, strengths, limitations, field of applications, future 
scopes along with related privacy concerns. 
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I. INTRODUCTION 

‘Autonomous weapon systems’ are defined as weapons that can 
independently select and attack targets, i.e. with autonomy in 
the ‘critical functions’ of acquiring, tracking, selecting and 
attacking targets [i]. Fully autonomous weapons can be enabled 
to assess the situational context on a battlefield and to decide 
on the required attack according to the processed information 
[ii]. In an Autonomous weapon a human operator can only in- 
tervene in the machine’s operations with a veto command [iii] 
- for instance, by activating an emergency stop button. In this 
case, autonomy is necessary because the available reaction 
timeframe precludes human interaction. 

There has been rapid progress in civilian robotics in the past 
decade and military interest in increasing autonomy of weapon 
systems is driven by the potential for greater military capability 
while reducing risks to the armed forces of the user, as well as 
reduced operating costs, personnel requirements, and reliance 
on communications links. 

Having great utility in modern military their use in the battle- 
field still is not in abundance due to some serious limitations 
such as differentiating between friendly and enemy troops. In 
advancement of technology along with many other methods, 
digital image processing based approach are very much prom- 
ising; overcoming these limitations in great extent. Recent re- 
searches suggested that it is possible to differentiate between 
usual and unusual behavior, normal or abnormal incident even 
friendly or enemy troops by applying an image processing me- 
thod [iv] . 

In most cases an autonomous weapon based on Image 
processing can be successfully employed to guard against the 
intruder or to restrict the unauthorized access in a no entry or 
limited access zone and in case of some other highly predicta- 
ble areas. 


II. METHODOLOGY 

The thesis work is divided into following stages: 

• Continuous image acquisition 

• Comparing two consecutive image 

• Getting the absolute difference between the images 

• Conversion of the difference image to Grayscale 
image 

• Enhancement of the grayscale image 

• Reduction of noise and further enhancement 

• Computation of areas of the disturbance 

• Determination of the biggest disturbance 

• Determination of the center point of the disturbance 

• Sending the location of the disturbance to the Weapon 
control unit 

• Setting the weapon according to the target location 
retrieved from the control unit After finalizing the 
target, the weapon starts shooting 
automatically. 



Fig. 1: Working Procedure of the system 

III. COMPUTER VISION[v] 

Many processes as image threshold, dilation, erosion and anal- 
ysis are used in dealing with the digital image [vi]. Digitizing 
an analog video signal is to convert the signal to be compatible 
with computer media to store and restore the signal; this is 
done by sampling and quantization. The value of the analog 
signal at each instant is converted to pixels, the smallest ele- 
ment of an image as shown in Figure (1). After the process of 
digitizing is completed, we have 2D of data constructed of 
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pixels, which contain the color information in each position of 
the image. 



170 

238 

85 

255 

221 

0 

68 

136 

17 

170 

119 

68 

221 

0 

238 

136 

0 

255 

119 

255 

85 

170 

136 

238 

238 

17 

221 

68 

119 

255 

85 

170 

119 

221 

17 

136 


Fig. 2: Digital image representation by pixels [vii] 


Each colored image is stored in three dimensional array 
MxNx3, number 3 comes from creating three layers of the ba- 
sics colors, Red, Green and Blue. These layers are composed to 
represent the true color image. Each colored pixel is composed 
of three values (red, green, blue), these values have the range 
between 0-255. 


IV. BACKGROUND SUBRTRACTION 

This section describes the method for extracting moving tar- 
gets from real time video stream. The approach is known as 
Background Subtraction [viii] which is the simplest method for 
detecting motion in a video frame. The main steps of detecting 
the target system are shown in Figure (2) are: 

1. Frames differencing. 

2. Detecting the moving target. 

The idea is to take the absolute difference between a references 
stored background and a new frame which is grabbed from the 
camera. If no target is entered, the resultant pixel is expected to 
be zero value (difference result), else, if a target exists, the re- 
sulting pixels will give a value different than zero as shown in 
Figure (2). 


currentframe 



background model 




THRESHOLD 

T 



foreground mask 



D = I IK-1 - IK I 

K: The frame number, I: frames, D: difference result 

V. IMAGE ACQUISITION AND PREPROCESSING 

Images are acquired using digital camera. The acquired image 
is in jpeg format taken from video which was in AVI format. 
The video frames are read in Visual Studio 
C++ using the command cvCaptureFromCAM() provided by 
OpenCV library. After reading two consecutive images the 
absolute difference between them are found using cvAbsDiff() 
function. The resultant image from the difference between 
those images is now converted to gray image using cvCvtCo- 
lor() function. The binary image from the gray image is found 
using cvThreshold() function. The noises present in the thre- 
shold image greatly reduced after dilation and erosion. As it is 
not possible to send all the locations at once, so the areas of 
the movement locations are computed and the biggest one is 
sorted out to send its location to the Arduino controller to con- 
trol the weapon accordingly. Following figures show the result 
of image preprocessing operations in which some movement is 
detected in a closed room. 



Fig. 5. Grayscale image of 1 st frame 



Fig.6: 2 frame 


Fig.3: Background subtraction model [ix] 
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Fig. 8: Difference in image of the l sr and 2 na frame 
(enhanced). 



Fig. 9: The spot is rectangled 
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Fig. 10: The disturbance location is sent to the weapon 
control system 

VI. AUTONOMOUS WEAPON 

The Autonomous weapon system (AWS) is suitable for deploy- 
ing all direct fire weapons. Close range missiles (e.g. TOW, 
STINGER) have smart munitions with sensors that are effec- 
tive over a narrow field of view. These weapons achieve opti- 
mum efficiency when deployed on AWS, because the weapon 
arming, uncaging, and firing are supported by electro -optic and 
other sensors that are more effective in terms of target dis- 
crimination and selection than the simplified sensors deployed 
in the missiles themselves. Directed energy weapons are sim- 
ply adapted to the AWS. These weapons require extremely 
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small lead angles, and are independent of gravity and envi- 
ronmental factors, in terms of aim point. The AWS automati- 
cally discards all ballistic algorithms if deployed with directed 
energy weapons, at the same time introducing corrections for 
atmospheric refraction and firing delay (typically 1 -2 milli- 
seconds). The atmospheric refraction corrections are required 
if the weapon wavelength and the sensor wavelength are not 
similar, and are particularly important for applications where 
the weapon and the target may be at different atmospheric den- 
sities. In this paper, mainly the method of employing toy guns 
are discussed as the other options are not available in public 
domain. It must however be emphasized that, once the threat is 
detected by the image processing unit and signal exported, the 
signal could be used to govern and direct a range of weapons. 

The control is weapon specific. Different control methods have 
to be applied for different weapon. This paper thus only shows 
how a nerf bluster toy gun can be governed and directed to- 
wards the threat successfully. The design of the nerf bluster 
toy gun is shown in fig. 10. 



Fig. 1 1 : Nerf bluster toy gun 

The details of this weapon with control unit is given in 
the following section. 

VII. WEAPON AND WEAPON CONTROL UNIT 

The weapon used, the nerf blaster toy is a direct fire type 
weapon which fires foam darts. The ammunition is manually 
loaded. A total of 12 darts or ammunition could be loaded at 
once. The direct fire weapon than can fire continuously by the 
trigger. Each time the trigger is pulled, one bullet is fired. The 
trigger is governed by one servo motor in this project. The 
trigger is attached to the servo by means of a string. When the 
servo rotates, the string gets wrapped up in the servo rotor and 
the trigger is pulled to fire one bullet. After the bullet is fired, 
the servo goes back to the original position. Releasing the pull 
on the trigger string. The following Fig. 11 shows the me- 
chanical arrangements made, to allow the autonomous weapon 
to move and acquire targets. 

The weapon control unit consists of mechanical parts, which 
are: 

1. Side brackets, 

2. Servo holders, 

3. Upper base and 

4. Fower base 
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The side brackets allow for the mounting of the weapon. They 
are directly attached to the weapon which hold the weapon and 
allow for rotation of the weapon by servos to change direction 
of weapon aim in the y-axis. The servo holder is the vertical 
plate where the servo for y-directional aim changing is placed 



Direct Fire Weapon 



Pan Servo 
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Servo Holder 


Side Bracket 


Tilt Servo 


Trigger 


Screw 


Fig. 12: 3D Design of the Autonomous Weapon 

and held. This must be strong and able to resist torque provided 
by the servo. The upper base rests on the pan servo and it total- 
ly contains the weapon, side brackets and the servo holders. 
The whole weapon system is mounted on the lower wooden 
base. 

And the electronics equipments are: 

i) Servo motors 

ii) Arduino Mega 2560 microcontroller board 

iii) Power supply unit 

iv) Power distribution board 

v) Program to run the motors precisely 

There are mainly three servo required for controlling the wea- 
pon smoothly; one for the pan movement, other for the tilt 
movement and the rest one is employed as trigger motor. In 
this case, standard 180° rotation servo motors were used. Ar- 
duino Mega controller is employed both to receive the signals 
from the image processing computer and to guide the weapon 
as it is programmed. 

Power supply unit is required to power the Arduino board and 
onboard servo motors. Operating voltage of Arduino is 5V and 
standard servo motors can operate between 6V to 12V. 

Power distribution board ensures the distribution of power to 
the different component according to their requirements. 


And the most important part of the control system is Arduino 
code which receives signal from the image processing unit and 
guides the weapon accordingly. 



frttzing 


Fig. 13: Electronics arrangement 


VIII. CONCERNS 


Despite the promise it holds, like everything else, image 
processing based autonomous weapons also come with some 
concerns. Before it is employed in any place, it has to be made 
absolutely sure that the security works 100% accurately. There 
is very little room for error given the lethal nature of the secu- 
rity. It is also to be made sure that only the military and the 
government has access to it and that it does not fall on wrong 
hands. To stop misuse, the security has to be made hack resis- 
tant. At no cost, should it ever end up on civilian’s hand, the 
consequences might be catastrophic. Wherever installed, it 
must be duly informed of the security’s presence so that un- 
wanted death or harm does not occur. The security must only 
be used only in case of 24 hour surveillance, highly restricted 
areas or in areas where human surveillance is not good 
enough. 

IX. CONCLUSION 

Making an autonomous weapon and employing it in real world 
applications is challenging due to the fact that the image 
processing techniques are not as fast as it requires in detecting 
the targets in real time. These techniques normally track slow 
moving objects and most of the cases the environmental condi- 
tions have greater impact on the final detection. The sizes and 
shapes are quite uncertain in real world applications. In addi- 
tion, the processing speed is strongly affected when higher 
resolution and frame rate cameras are used. 
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In this thesis, we used background subtraction, which is one of 
the simplest techniques available, to reduce the processing 
time. 

Despite the existing limitations [x] such as the strict require- 
ment of proper lighting and slow motion, the result showed that 
background subtraction is a feasible solution for detecting mo- 
tion and acquiring target for the autonomous weapon. 

There are some issues remaining for future work. Currently, 
parameters associated with the technique need to be set up ma- 
nually. They need to be reset when the camera is moved to a 
different location. In the future, a mechanism which can auto- 
matically configure these parameters can be constructed. To 
compromise with the complex and unstable environments, 
a more robust technique needs to be developed which is able to 
detect and track efficiently in both indoors and outdoors envi- 
ronments. In the future, we hope to make improvements in the 
state estimation in order to reduce the chances of needing to 
search the entire image. 

Another avenue for future work involves discriminating be- 
tween normal and abnormal motion of objects based on beha- 
vior analysis [xi] . 


X. REFERENCES 

i. https ://www. icrc.org/en/document/report-icrc-meeting- 
autonomous-weapon-systems-26-28-march-2014 

ii. http://www. reachingcriticalwill. org/resources/fact-sheets/critical- 
issues/7972-fully-autonomous-weapons 

iii. http: //www. css. ethz. ch/publications/pdfs/CSSAnaly sel 64 -EN. pdf 
(Date of Access: 07.05.2015) 

iv. Narayan, N. S., Marziliano, P., Kanagalingam, J., Hobbs, C.G.L. 
(2014), " Speckle in Ultrasound Images: Friend or Foe?” IEEE International 
Conference on Image Processing, Paris, France, Oct. 27-30, 2014. 

v. https .-//en.wikipedia. org/wiki/Computer_vision 

vi. Ben A. Greene, Steven Greene, Digital image representation by 
pixels, Publication Number: US7210392 B2. 

vii. http .-//hosting, soonet. ca/eliris/remotesensing/bll 301 eel 0. html 

viii. https ://en. wikipedia. org/wiki/Background_subtraction 

ix. http ://docs. openchttp://docs. openev. org/master/dl/d 
c5/tutorial_background_subtraction. htmlv. org/mast 
er/dl/dc5/tutorial_background_subtraction.html 

x. http://www. mva-org.jp/Proceedings/Commemorati 
veDVD/1 988/papers/l 988001.pdf 

xi. Alberto Amato, Vincenzo Di Lecce, Vincenzo, Piuri, Semantic 
Analysis and Understanding of Human Behavior in Video Streaming, ISBN: 
978-1 -46 14-5485 -4(Print) 978-1 -4614-5486-1 ( Online ). 


IJER@2016 


doi : 10.17950/ijer/v5sl2/1212 


Page 935 


